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Kmhedding supplemental data in an encoded signal 



5 HELD OF Tl IB INVENTION 

The invention relates to an arrangement and to a method lor embedding supplemental 
data in an encoded signal. 

10 BACKGROUND OFTHR INVRNTION 

There is a growing need lo accommodate .supplemental data in encoded data like 
eneoded audio and video signals, preferably without increasing the dala rale. Hspeciully 
if the supplemental data is used as watermarks, it should he added in a perceptually 
15 invisible manner. Watermarks may eornprisc information, for example, about the source 
or copyright status of documents and audio-visual programs. They can be used lo 
provide legal proof of the copyright owner, and allow tracing of piracy and support the 
protection of intellectual property. 

20 The Super Audio Compact Disk (SACD) Format, for example, specifies lossless coding 
(LLC) to allow about twice as much data effectively on the disc. The lossless coder is 
required to allow a playing time of up to 74 minutes of multi-channel audio in SACD 
quality. As the word lossless coding points out. the required storage capacity of any data 
is reduced in u *ay that after decoding the original signal is reproduced bit identical. 

25 Such an encoder / decoder is described for instance in Pons Biuckers, Werner Oomcn, 
Rene van der Vleutcn, I -con van dc Kerkhor, Improved lossless Coiling of" l-IJii Audio 
Signals, Audio Engineering Society, I03 ,xl Convention 1997, September 26-29, New 
York, 4563 (I G). Kneoding is performed by partitioning an input data stream into 
frames and determining for each frame a set or optimised parameters. Part of these 

30 parameters are used for prediction to remove redundancies. The difference between 
original signal and the prediction signal, which is called residual signal contains very 
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Icss relevant information, if good prediction parameters could have- been found. As 
lossless coding is intended, the residual signal can not be omitted, hut if it contains less 
relevant information it can be entropy encoded very efficiently using some other part of 
the optimised parameters. As the redundant information is held in the parameter set the 
5 parameter set as well as the entropy encoded residual signal are stored and needed for 
lossless decoding. 

If supplemental information is needed, for instance for purposes of watermarking, ct 
may be added as it is fairly wide known - by adding ii to the original signal, in a way, 

10 that the signal amendment will not he remarked by a listener. Anyway n signal altered 
like this could no longer be considered as an (bit true) original signal. Additionally this 
kind of watermarking suffers from the fact, that it is not possible to delect watermarks 
present in the encoded signal without lossless decoding. Tor (he reason of simplicity of 
the watermark decoder it is desirable to have the option to detect watermarks prior to 

15 lossless decoding 



OBJKCr AND SUMMARY OF THE INVENTION 

2f) It is an object of the invention to provide an arrangement and a method of embedding 
supplemental data in an encoded data signal, which allows reading the embedded 
supplemental data without decoding the whole signal and docs not influence music 
quality. 

25 To this end a method according to the invention is characterised in thai for embedding 
supplemental data the supplemental information is inserted into the data and the 
auxiliary information needed to encode the supplemental data is derived from other data 
available in the encoding process. 



30 The advantage of the invention is, that by inserting the data into the data to be encoded, 
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the supplemental information can not be removed without disturbing ihe content of the 
encoded signal. As rhc auxiliary information needed to encode the supplemental 
informal ion is derived from other data available in the encoding process, Ihc auxiliary 
information to encode the supplemental data must not be recorded or stored for a Inter 
decoding process. Thus this method is very economic with respect to the bit rule. 

It is another object of the invention to give an alternative lo the first solution. 

To this end, a further method according to the invention is characterised in thai for 
embedding supplemental data into the encoded signal the parameter set is affected by 
Ihc supplemental data. Thus not all the complete data has to be decoded to read a 
watermark, but only the pail of the data where the parameter* used for encoding/ 
decoding arc contained. As ihe supplemental information is embedded in the parameter 
set, no additional bit has to be spend for this information. 

The supplemental informal ion may be embedded by choosing an even or odd number of 
parameters or by changing the least significant bii of e.g. the first parameter. As an 
example an even number of parameters represents ihe value 1 1* of a watermark bit; an 
odd number of parameters represents the value *(V of a watermark bit. 



The invention takes advantage of the fact that Tor practical Reasons (compulation power, 
costs, ...) not the hesi set of parameters is determined for encoding, bul a somehow quite 
good set of parameters. Therefore those algorithms have been designed to work with a 
suboptimal set of parameters as a rule. Therefore small changes in the parameter set, 

25 like changing the least significant bit of a parameter, adding a dummy parameter in 
order to achieve an odd or even number of parameters, whatever is needed to embed a 
watermark bit or even omit an parameter in order to achieve the odd or even number of 
parameters will have no huge impact on the encoding efficiency normally. Sometimes 
such a small variation of the parameter set may even marginally improve the encoding 

30 process. 
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An advantage of the invention is, that, if the data should be kept in lossless coded form, 
the watermarks cannot he removed without decoding the signal and repealed lossless 
encoding the data with an altered set of parameters. As Ihc lossless decoder requires all 
5 coefficients a missing or wrong coefficient, which has been removed or changed to 
delete Ihc walermark will result in a signal loss for the duration or a frame for all 
channels. 



10 DESCRIPTION Oh' KMUOOIMENTS 

Fig. 1 shows an arrangement lor embedding two independent supplemental data x, y 
into a lossless coded signal, hirst data x are used U> embed a watermark information w. 
As the length of the watermark w is longer than the information that could l>c stored by 

15 the supplemental data, the watermark w is packaged by a package generator I to a 
transport packet, which enables to embed the bits of the data package like a serial 
.signal. By means of a synchronisation pattern included in the header of the Inmxport 
packet the beginning or the transport packet could be retrieved easily. The bits x of the 
'.transport packet are embedded bit by bit to the lossless coded signal as so called 

20 DST_X_Bits. 

Second data y is embedded by so called DST„ Y Bits. At current an embedded 
DST_Y_Bit is set to the value *V to indicate thai the lossless coded signal applies to the 
up to date format. If there will occur any need in future to have a Hag the DST_Y_Bil 
25 may be used, It should be obvious to the person skilled in the art that in other recording 
systems, the DST. Y Bit may also be used in the form of a structured data stream to 
embed information longer than a single bit. 

In order to encode n parallel data streams, which are referred to ;is data channels Co ... 
30 C„,|. the stereo or multi-channel DSD recordings are partitioned into frames. In the 
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embodiment of the invention seventy five frames per second are used for each channel 
G. Although the data rate of the watermark signal w depends on the frame rule, the 
invention is not restricted 10 a special frame rate. 

5 For each frame a control arrangement, which is nol shown as il is not u p;u1 of the 

invention, discriminates which mode is used for coding: LLC Plain mode or LLC Coded 
mode. The LLC Plain mode is used in exceptional cases if the compassion ratio of a 
frame is insufficient, and actually contains plain DSD. 

10 The chosen LLC algorithm is based on a prediction filter and a probability table. To 
optimise the compulsion ratio of the LLC Coded mode a parameter control unit 4 
analyses every frame again each channel separately. The parameter control unit 4 
calculates for each channel C 4 a set of prediction filter coefficients A; = a;(l ) ... a;(ki) for 
each prediction filter and a set of probability table coefficients Hj = n\(\ ) ... ttj(mi) for 

1 5 each probability tabic. In the embodiment of the invention the length of a piedieiion 
filter coefficient ai is nine bit, whereas the number kj of prediction filter coefficients is 
variable* but is restricted to a maximum value of 1 28. T>ach probability table coefficient 
Ttj has a length of seven bits. The number m t of the probability table coefficients n t is 
also variable, restricted by a maximum value of sixty four. Typically il is between thirty 

20 two and sixty four. These numbers are given as an example and represent the numbers 
which have been found to give best results for audio signals, hut should not he 
interpreted us an restriction of the invention to those numbers. The numbers of course 
depend on Ihc frame rale, the prediction filler algorithm and the content of the source 
signal. However it is possible that cither numbers might be found, which will allow a 

25 better compression ratio. 

Determining optimal coefficients a t fi is difficult and requires considerable computing 
power. Therefore a compromise is made to select just a quite good set of coefficients. 
As a scpattiic coefficient set Aj, 11; s calculated for each channel Cj, the coefficient sets 
30 used for each channel will differ from each other, but must not in any case. 
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To insert an DST_Y_Bit into a frame a flag gencralor 3 alters ihc Inst significant hit 
LSB of the first filter coefficient a D (l ). As already mentioned before by slightly altering 
the filler coefficients no substantial decrease in encoding performance should be 
5 realised. 

All tbe coefficients of the sets A and Tl including the modi Med coefficient ao(l) arc 
substantial for the encoded signal and thus must be recorded for a later read or decoding 
process. As the all coefficient sets A us well H still contain some redundancy a first and 
10 a second compressor 5. 6 is used to generate compressed data words A' , n\ Preferably 
a compress algorithm is used, which will allow the corresponding decompression of A* 
and IT in an most easy way, so that reading the embedded DST_Y_Bit could be done 
without big efforts. 

1 5 It is important that the coefficients, the value of which have been modified are also used 
for the lossless encoding instead of the original evaluated coefficients. Otherwise ihc 
decoding process will fail. The function of the lossless encoder is split up in this 
embodiment of the invention into an encoding predictive unit 7 for each channel Cj and 
an arithmetic encoder 9 common to all encoding prediclive units 1. The structure of un 

20 encoding predictive unit 7 is shown in figure 2. 

A encoding predictive unit 7 comprises u predictive filter 71 which is initialised with 
the corresponding filter parameter set A|. By means of o level converter 72 a hinary -<V 
of the input signal is converted into the numeric value *-T and a binary value * T is 

25 converted inln the numeric value *+T prior to input the input signal to the predictive 
filter 71. The output signal of the predictive fitter 71 is quantised by a first and a second 
quantiser 73, 74. The output signal of the first quantiser 73 is cxnred with the input 
signal Xj by means of u EXOR gate 75 and forms the residual signal c t , which is the first 
of two output signals of the encoding predictive unit 7. The output, signal of Ihc second 

30 quantiser 74 serves as an index Uj for a probability table stored in an array 76. The 



1 
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probability table consists of the probability parameter set Flj . The output signal of the 
array 7f> forms the second output signal of the encoding prediction unit 7, the 
probability signal pj. The usage of the probability table is described in greater detail in 
the paper cited in the opening paragraph. 



A multiplexer 8 merges the residual signals Co ... c n .i into c as well as the probability 
signals po ... p„.| into p. The output of the watermark generator 2 is also fed to one input 
of (he multiplexer 8. To em heel the DST.X._Bits of the watermark informal ion the 
mulitplexer 8 inserts the DST_X__Bil in front of c. Doe to the design of the arithmetic 

10 coder 9 a probability coefficient ro code the DST_X_Bit % hereafter referred to as the 
watermark probability coefficient: p w is indispensable. To save storage space in the 
embodiment nf the invention the watermark, probability coefficient p w is derived from 
the first predictive filler coefficient an(l). Hereto the first predictive filler coefficient 
ao(l) of the first channel is fed to n watermark probability module 10. By means of this 

I s module the first seven bits of the coefficient ao( Dare interpreted in reverse order as an 
unsigned integer number 15 In which the value I is added. By using a derived value for 
the watermark probability coefficient a recording of the watermark prohahility 
coefficient is not necessary and requires no supplemental hit in the encoded data block. 
In this way embedding the DST_X_Bil will lengthen the coded LLC block only 

20 marginally. 

The arithmetic coder 9 generates from the signal c and the probability signal p the 
Coded DSD signal. 

25 As the DST_X_BH is inserted as the first bit of each block 10 be coded by the arithmetic 
enrier 1 ), 1he l)ST„X_Bit may not be located us a single hit in the Coded DSD signal. 
Therefore it can not be removed without decoding the Coded DSD signal. Deleting or 
changing one or some bits inevitably will cause a data loss of data of the whole frame, 
On the other hand to read a watermark a rudimentary arithmetic decoder is sufficient. 

30 Hence it meets the ideal of a waLermark in a perfect manner; difficult to remove but 



^^mjM^J^BNOiKN.pe =13- 1 -99 . : . .. ^^^—12?- 9122 62345-.. +49 89 23994*^ =^9 ^. 

PHN 17285 EP-P 

-8- 



easy to read. However it is not mandatory to insert thcDST_XJ3it in front or" the signal 
c, but it will slightly simplify the decoding process of the watermark, as only the 
beginning of the C<xled DSD signal has to be evaluated. 

S The fill lowing tabic shows the rough syntax of h frame coded in the LLC Coded Mode: 



LLC bit i CNTRL 



CODED DSD i 



The bit LLC in this case has ihc value ' I * lo indicate a LLC Coded mode data block. 
The bit* of the CNTRL sub block contain sonic control information, as for example the 
1 0 number k, of prediction filter coefficients und the number m, of probability coefficients 
Of u gi ven channel Chi. The next two sub blocks A* and IT contain the sets of the 
prediction filter coefficients A and the probability coefficient* 1 1 in compressed form. 
The last block CX>PKI> DSD finally contains the coded DSP signal. As explained 
earlier, the length of the data blocks A, P and CODHD PSD varies from frame 10 frame. 

15 

The LLC Coded data blocks arc written to a data carrier like a SACD or a PVD for 
example. As the writing process to the data carrier and the reading process from the data 
earner is nol part of the invention, but a lot of appropriate moans are known to the 
person skilled in the art, this is not described herein but symbolised by the dashed line 
20 ) 1 and referred to as disk interface. 

In the reading device, here in the embodi ment of the invention u S ACD or a DVD disc 
player for example, a data block is dcrcctcd as being a LLC Coded block if ihc first bit, 
the 1 .1 C-Wt has the value * l \ In this case the data block, is divided into \la sub blocks 
25 A' , n ' and CODED DSD by means of the data contained in the control data block 
CNTRL. The sub blocks A' and IT are decompressed by a first and a second 
decompressor 12, 13 to regain the coefficient sets Ai, fl,. For each channel a separate 
decoding prediction unit 14 is foreseen, each decoding prediction unit 14 comprising u 
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predictive filter unci a probability tabic. At the beginning of decoding a UX! encoded 
block the coefficient sets Au I h arc loaded to ihc appropriate prediction 11 hers and 
probability rabies of the decoding prediction units 14. 

5 The decoding predictive units 14 arc also reconstructing the probability signals p^.-pn-i. 
which arc combined lo the signal p by u multiplexer 15 of the reading device to the 
signal p. The signal p is led lo an arithmetic decoder 16 which by means of the 
probability signal p decompresses the data contained in the sub block CODED DSD to a 
dala streams e. By means of a demultiplexer 17 the data stream c is split into the 
10 different: residual signals e 0 ... e n „ ( of the individual channels and led to decoding 
prediction units 14. 

The structure of a decoding prediction unit 14 is shown in figure 3. The residual signal 
c, of each channel is fed to a first input of an CXOR gate of the decoding sub unit. The 

1 5 output of the EXOR gate forms the output signal of each channel Ch\. The oulput signal 
is also led to a level convener, which perform the same operation as the level converter 
in the recording device described earlier. The output or the level converter is fed to the 
predict! ve fi Iter. The output of Ihe filter is fed to two quantisers. The output of the first 
quantiser is connected with the second input of the EXOR gate, the other oulput of the 

20 quantiser is used as an index a t for the probability table slored in an array. The values p* 
of all which is selected by the index a; arc fed via the multiplexer lo the arithmetic 
decoder, 

A flag detector 18 is used to reconstruct the embedded IXST_Y_Hits. As the 
25 DSTJY_Bit is stowed in the first coefficient, only the beginning of the compressed A' 
block has to be examined by the flag detector I S. The flag detector 1 8 decompresses 
only the beginning of the A' block and picks out the first: filter coefficients a<i(l) of the 
first channel and analyses the least significant bits of it to decide the value of the 
L>ST_Y_Mit, As the compressing algorithm for the A and 1 1 blocks was chosen to 
30 enable easy decompression; the watermark detector could be designed very primiti ve 
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eompured to the total decoder. 

To extract the watermark w, the coefficient ao< I) determined by the watermark Hag 
detector 1 8 is fed to a watermark probability module 1" of the pending device. The 

5 watermark probability module calculates as described Tor the recording device the 

watermark probability coefficient p*. The watermark probability coefficient p w is fed lo 
the arithmetic decoder to decode the F3ST_X_BU. As the DST_X_Bil is the fii>il bit 
nutputled by the arithmetic decoder, it can easily be extracted out by h watermark 
detector 20. However with a more sophisticated detector it may be exiracled from 

10 anywhere in the signal, wherever it has been decided to insert it. A. formatter 2 1 extracts 
from the DS'l„X_Bils, which are reconverted from a serial bit stream to data block with 
the help of the synchronisation pattern the watermark informal i»n w. 

Although the watermark detection fundion could have been integrated into the other 
1 5 decoding means of the reading device, this structure shows, that a watermark detection 
could be done stand alone. There is no need to decode the whole coded PSD signal . 
Therefore the watermark flag detector 18, the watermark probability module 19, the 
watermark detector 20 and the formatter 21 also could integrated in a device of its own 
and be rim without the more complicated functions incorporated in the decoding 
20 prediction units 14 for instance. 

Up to now the LLC Coded mode has been described. As described above, sometimes if 
encoding fails to reduce the hit rate the signal can just be stored as plain DSD. This data 
mode is named LLC Plain mode and shown just below: 



25 



LLC Bit 



DTS.X Bit ! Plain DSD 



The LLC hit is set to the value of '0' to indicate that the frame contains Plain DSD. The 
bit following to the I I -C Bit. is used to store the DTS_X_Dit of the watermark in plain 
formal. The DTS_X_Bit is followed by the Plain DSD data. By this it is ensured, that 
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every coded block contains a nTS„X„!Jit, regardless if it is a Ctxled DvSD or a Plain 
DSD block. This has the advantage that the serial data stream of the DST_X_Bils does 
not depend on which formal is used. On the other hand it is true thai ihe plain 
D'i\S_X_bit or a Plain DSD could be changed without making harm lo Ihe signal 
5 content of a block in Plain DSD.. But as a Plain DSD block is the exception in the big 
majority there will be more than enough uninterrupted Coded DSD blocks, to carry ihe 
watermark in lull length. 

In a further embodiment of the invention more than one supplemental bit is embedded 
|0 into the lossless coded signal, by changing more than one LSI* of Ihe parameters. To 
embed two bits per frame for instance the first, and the second predictive filler 
coefficient a 1(0), a 2 (0) of the first audio channel are unused These two bits may be used 
to represent the following information: 



LSB ao(1) 


LSB M2) 


Meaning I 


0 


0 


Watermark bit '0* I 


0 


1 


Watermark bit ' 1' 

i 


1 


0 


Synchronisation symbol j 


1 


1 


Reserved for future use j 



As only one watermark bit is foreseen to be used in each frame, the watermark 
information has to be written in a serial data format. Therefore the synchronisation 
symbol MO* serves lo delect the beginning of the watermark information. 
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1. Method for encoding dots) (e) by means of auxiliary information (p). 
characterised in tha t 

for embedding supplemental duia (x) tho supplemental information (x) is inserted into 
the data (e) and the auxiliary information (p w ) needed to encode the supplemental data is 
5 derived from other data (at/ 1 )). 

2. Met hod for extracting supplemental data of encoded data as defined in claim I . 

3. Method fur encoding input data by partitioning the data into frames, determining for 
1 0 each frame a set of parameters, reducing the data of the input signal by applying an 

algorithm which is controlled by the parameter set whereby the encoded data comprises 
the set of parameters or al: least data which can be used to derive the parameter set and 
the data rate reduced signal. 
characterised in th at 

1 5 for embedding supplemental data (y) into the encoded signal the parameter set is 
affected by the supplemental data (y). 

4. Mclhocl for extracting information which is embedded in the parameter set c>r an 
encoded signal as defined in claim 3. 

20 

5. Signal comprising encoded data according to claim I or 3. 

6. Pat a carrier with a recorded signal according to claim 5 

25 7. Arrangement for performing a meih<xl according, to claim 1 . 2. 3 or 4. 

8. Playback device with an arrangement described in claim 2 and/or 4. 

9. Playback device according u> claim 7 characterised that it is a Disk player for audio 
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and audio-visual media respectively. 



RO-...VOM:FR*..Ml!ENCHEN 06 : 13- 1-99 .-. .»*}$7.^.„.. +49,0122. e£M6~... . ++9 89 2399446S i# 1 5. 




RCV vr>M : PPA MIIENCHEN Oii : 13- 1-99 : ^m^L^^**§.?J??. 9%&*»... H9 89 239944KJ.15 




IC*: VO\V,^?V.MUENCHEN 06 : 13- i-99 : ..'.MJ..-..9.X..;. *4Q U1.22 C234;>-» +4-9 89 2;»au4-4.«F5 f 

PI IN 17285 liP-P 

- .13 - 



and audio-visual media respectively. 



